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ABSTRACT 

In the Learning Research and Developirent Center 
(LRDC) Beginning Reading Program, vowels are color-coded so that 
different spellings, representing a single vowel sound, maintain some 
feature in common. Such color-coding imposes a structure which 
effectively reduces the uncertainty in associating visually different 
stimuli with a similar oral response* The program consists of two 
sets of twelve children's books with color-coding used systematically 
through Book 8 or 11* Words are color-coded according to rules 
applying to each set of two stories that follow the introduction of a 
new phoneme- to- grapheme association, with the amount of color 
prompting reduced in the alternate set of readers. In the second 
story of the first set of readers, only words which have not 
previously appeared at least five times in color in prior stories are 
color-coded. In the alternate set of readers, only words which have 
never appeared before in prior stories are color-coded. During 
1969-70 several studies were made to determine the effectiveness of 
color-coding: a testing program to prove pupil achievement, a study 
to investigate the question of how much color prompting benefits the 
pupils, and a test to determine how well individual elements were 
learned by the same children. (HS) 
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TEST PROJECT FOR Tf^E LRDC BEGINNING RLADINH PROGRAM 
"STEPPING STONES TO READING"''^ 

He I en M. Popp 
Harvard Un i vers i ty 

I ntroduct i on 

The Beginning Reading Program 

In the LRDC Beginning Reading Program, originated by Paul M, 
Kjelderqaard, vowels are "color-coded" so that different spellings, all 
of which represent a single vowel (sound), maintain some feature in com- 
mon. Other than altering the traditional orthography (as in ITA), color- 
coding is the one way to provide a visual prompt for the learner which 
indicates to him that different letters, or different groups of letters, 
do, in fact, represent a similar sound. 

Such color-coding imposes structure which may be used by the student 
to effectively reduce the uncertainty in associating visually different 
stimuli to a similar oral response. It also effec^ ely signals the dif- 
ferent oral responses which are associated with the same visual stimulus. 
For example, the underlined letters in the following words are all asso- 
ciated with a similar sound or phoneme: h igh , kj^te, and fly^; therefore, 
all three are printed in the same color in the Beginning Reading Program. 
The letter i in each of the following words, however, is associated with 
a different phoneme: kite, krf, and fj^r; therefore, the in each case 



Paul M. Kjeldergaard, Roselyn Frankenstein, and Robert Glaser, Steppi ng 
Stones to Reading: Experimental Edition. New Century/App I eton-Century- 
Crofts, Inc., 1969. 

Herbert Simons served as research associate throughout the project, and 
in addition to administering the tests, he had responsibility for tfie 
stati St i ca I ana lyses. 
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is printed in d different color. The color-coding usod in \\)e pr onron 
ar.siqns purple to the underlined elements in the throe words wlierc thev 
are associated with one sound (h igh , kMe, fly), and as fhe oroor.m^ pro- 
qressos, it assigns other colors to associated with other sounds, o.i]., 
red for the \^ in k_i^1 and dark green for the ir in fir. Consequently, 
without distorting the alphabet letters, materials do introduce different 
graphemic representations of each sound. These represental ions ar e pre- 
sented together, all printed in the same color to signal the fact thjf 
they are all associated with the one sound. As far as Ibis author knows, 
this reading program is unigue in seguencing sound-to-sight or auditory- 
to-visual materials where the various visual representations of vowel 
sounds are introduced simultaneously. 

Use of Color-Coding 

The LRDC Beginning Reading Program is essentially a "decoding" pro- 
gram wi1h a heavy emphasis on phonics. It consists of 12 children's books 
and 12 associated workbooks. Color-coding is systematically used through 
[Book 8. Each phoneme is introduced, and if it is a vowel, its various 
graphemic representations are introduced In color. Vocabulary words are 
presented and studied using the color-coding, and two stories which use 
only words containing elements previously taught or being taught are in- 
cluded to be read before the next phoneme-grapheme association is tauglit. 
Words are color-coded according to the following rules which apply to each 
set of two stories that follow the introduction of a new phoneme-to-grapheme 
association: 

1. In the first of the two stories, all vocabulary using 
the phoneme-to-colored grapheme association being taught 
are co I or-coded. 

2. Also in the first story, words using previously taught 
associations still being carried in color a1 that point 
in the program are color-coded. 



5. In the second story, only words which have not proviou^-ly 
appeared at least five times in color, in prior o tories 
are color-coded as long as that color is beinn rur-riod* 

t'ach colcr remains as a prompt for vocabulary Ihrouqhoul IB-z'O stoMe*. 
accordincj to the schedule found in Figure !3-A of this report, Ihur,, 
color prompting is systematically withdrawn as well as sys lema I i ca II v 
i nt roduced. 

Alternate Readers 

Field trials of the first several versions of this program are re- 
ported in the Summary Report (Frankenstein, 1971), and the results are 
compared with the 21 United States Office of Educatior First-Grade Studies. 
A desire to probe the effectiveness of the color-codi nq and possibly oven- 
tually to provide alternative "tracks" within the proqram for individuj; 
children occasioned the development of a set of alternative readers for- 
Bock 5 through Book II. The content of the books is identical to thai o< 
the original reader with one exception — the amount of color prompting. 
?ooks in the standard version (hereafter referred to as SV) were printed 
with the color-coding as described above. The amount of color prompting 
for each color was reduced in the alternate set of books, the reduced 
color version (hereafter referred to as RCV), but all II colors were used 
as in the SV. In the RCV, after a new element is introduced, words in 
the two stories which follow are color-coded according to the following 
ru I es : 

L In the first story, all words using the new element (the 
one being taught) are color-coded. 

2. Also in the first story, words using previously taught 
associations still being carried in color at that point 
in the program are color-coded only the first five times 
fhey appear . 

3. In the second story, only words which have never appeared 
before in prior stories are color-coded as long as that 
color is being carried. 




These rules provided for a difference only in the Cimount of color-codi n:: 
used, rind they were applied consistently cjcross the entiro \>et of rt?jJorb. 

Test i ng Program 

In September 1969, the testing program was; initiated to Drobe sonie 
questions relevant to Ihis color-coding ( rocedure. As each book was com- 
pleted by the students, a test was administered to a i ve cin indication of 
pupil achievement in: • 

1. Reading words in isolation, printed in black only, which 
are used frequently in the instructional books. 

2. Reading words^ in isolation which are not used in the 
books or used very infrequently. 

3. Associating the colors taught with their corresponding 
phonemes i n words . 

4. Reading words in the context of sentences, both with 
and without color-coding. 

5. Reading sentences testing those words containinq phonic 
elements which had not yet been taught in the sequence 
("tarqet words"). 

The task devised for (I), (2), and (3) above was a recognition task: 
the examiner read a word and the student circled the cor red word from 
among four choices. Task (4) consisted of sentences containing a blank, 
and the reader selected one word from among four choices as correct for 
the blank space. For task (5), individual students read the sentences 
oral ly to the examiner. 

The format of the various tasks remained the same from Ihe first test 
in the sequence (Book-Test 1-2) to ihe last (Book-Test 12), but as the 
testing program got underway, it became apparent that the children found 



All of these words are, in general, highly frequent words, i.e., mostly 
A or AA words on the Thor nd i ke-Lorge List (Thorndike & Lorge, 1944). 



the tests much too long. A decision was made to fofocjo orir:inal p I jn--. 
both to test the phonic elements in all feasible positions in wor-Js .jn j 
to have multiple items testinq the same thing as a reliability cnock; 
fhus, the tests were shortened. A pattern for test construction w js fi- 
nalized and Book-Test 4 was ihe first test used which conformed icf^U'o 
Datiern that was used on all remaining books. That pattern is outlined 
in Table I, and the specific elements tested are presented in Table ?, 
A complete set of the written tests used throughout the year is on file 
at LUDC. Appendix A is a set of general rules used for test construction. 
The oral sentences read by the students are found in Appendix B. 

Children were generally taught in "reading groups" by their own 
te.ichers in each of tlie three classes; their rate of progress is indi- 
cated in Figures I , 2, 3, and 4. Figure I shows how many stuc'ents in 
each class completed each book (1-12). Figures 2, 3, and 4 descril^e tlie 
progress of chi Idren in each reading group for each class, showing over 
what period of time a particular group was working on each book. As can 
be seen, the children's progress through the program in Class III dif- 
fered from that in the other two classes. One male examiner was respon- 
sible for all testing; he was sometimes assisted by a female examiner, 
lie went to the schools regularly twice a week. The teachers agreed to 
inform him as soon as children completed their books in order that he 
might test them before initiation of their reading in the next book in 
the sequence.^ He took groups of children from their classroom to another 
room in the school and administered the writ-^en tests, following which he 
tested them individually on the oral sentences. For each book-test, he 
also had a very small sample of children go through the test orally, read- 
ing the isolated words (rather than recognizing and circling ihem), and 

5 

also reading the cloze sentences aloud. 



Some problems arose from this arrangement and some children were neve- 
tested on some books. For that reason, the data analyzed reflect vary- 
ing students from book to book. 

These data on oral testing have not been tallied or analyzed but are 
avai lable. 

KM 



TABLE 1 



Test Items for Individual Phonic Elements Taught in Program 



TASK PRINT TARGET WORDS 


"Recognition" 


Black 


High frequency in book 


Low or 0 frequency in book 


ColorCoded 


High frequency in book (high 
frequency words were not 
tested after Book-Test 6) 

Low or 0 frequency in book 


"Cloze" 


Black 


Same words used in 
"recognition" task above 


Color-Coded 


Same words used in 
"recognition" task above 


"Oral Reading 
of Sentences" 


Black 


Words which are not yet 
"permissible" in the system 
because they contain one 
element that has not yet 
been taught but will be 
taught in the next book 
(target words are not 
designated in any way to 
the student) 



TABLE 2 



Phonic Elements Tested in Each Book-Test 



TASK 



BOOKS 1 & 2 



BOOK 3 



BOOK 4 



BOOK 5 



BOOK 6 



I 



/ 0C/ 

I e / 



/iv/ 







pai 


a 


/ey/ < 


• aCe 


e 




^ay 


ee 






ea 


/ay/ < 


.r 


V 














iCo 



/ i / 



/ ow / 



H .2 



CD 

1 

c 



O -o 

? 5 



c 
o 

c 
o 
o 



> 

o 

o 
o 



/ f / 
/ 1 / 
/ d / 

/ m / 
/ n / 
/ s / 
/ St / 
/ nt / 



l9tl 

I 0 / 



/iy/ 



f 
t 

d 
m 
n 

s,ss 

St 

nt 



/ I / 



/ k / 



/fl/ 
/kl/ 



/ b / 
/bl/ 
/O / 



b 
bl 

Imb) 



h / 
P / 
/pl/ 



h 
P 
pl 



/ r / 

lii 

/kr/ 
/br/ 
/str/ 



/ay/ 



/oy / 



ay'> 



/ i / 



i6 



/ ow / 



o 

> 



ID 



"O 
a> 
"O 

o 

ll 0) 

o o 
o > 



c 

c 
o 

c 
o 
o 



/ae/ 

/ 0 / 



/iy/ 



/oy / 
/ay/ 



aCe 
iCe 



/ i / 



/ ow / 



/ e / 



/iy/ 



/ey / 
/ay/ 



aSo 
i^Co 



/ i / 



/ n / 


• n 


/ t / 


• t 


/ m / 


• m 


/ s / 


• s,ss 


/ f / 


. f 


/ d / 


• d 



/ b / 


' b 


/ h / 


• h 


/bl/ 


• bl 


/ P / 


• P 


l<t> 1 


• b.mb 


/pl/ 


• pl 



/ ow / 



Nolo: Numbers placed above the letters in the table refer to 
letter color-code: 1 = red, 2 = light green, 3 = tan, 
4 = purple, 5 = light blue, 6 = pink, 7 = orange, 8 = grey, 
9 = dark green, 10 = yellow, 11 = chocolate. 



TABLE 2 (continued) 



TASK 




BOOK 7 


BOOKS 


BOOK 9 


BOOK 10 


BOOK 11 


BOOK 12 


"Recognition" Task 
(words in isolation) 


Vowels 


/ a / ^ 

1 Of 1 i 


o 

[ a(r) 


/ 0 / j 
/aw/ { 


aw 

ou 
ow 




/ U / -00 
/ UW / -00 

/ J / • u 


/uw/ ^ 
/ OV / ^ 


ew 
. ue 
uCe 

oy 
oi 


L 


Consonants 


/ r|k / . nk 
/ ij / • ng 




1^1 • th 
/ g / • g 

1 V4 1 • W 


1 ch 
/ / f 

] tch 


/hw/ 

/ V / 

/ V / 


• wh 

• V 

• V 


/ 2 / -2 

/ks/ • X 
/ kw / • qu 

/ i / • i 

/ f / • ph 
/ s / • c 
/ i / -9 




Color of Vowels 


/ a / \ 

/ ar / 1 


■ ir& 


/ 0 / < 

1 
J 

/aw/ ^ 


all 
. oil 
aw" 

' oulO 
' owlO 


















"Cloze" Task 
(words in context) 


o 
> 


/ a / 1 
/ ar / 


I a{r) 

5; 


/ 0 / 
/aw/ ^ 


aw 

ou 
ow 




/ U / -00 
/ UW / • 00 

/ a / . u 


/ UW / 

/ OV / < 


1 ew 
• ue 
1 uCe 

r oy 


/yiiw/ 

I ew 


Color-Coded 
Vowels 


/ a / < 


a8(r) 

er 

• ir 
ur 

L 


/ 0 / " 
/aw/ { 


[a" 
- oil 
1 aw1» 

oulO 
* owlO 


















Consonants 






1^1 - th 

/ 9 / • g 
i w / • w 


/ / ). 

l^tch 















Note: Numbers placed above the letters in the table refer to 
letter color-code: 1 = red, 2 - light green, 3 - tan. 
4 - purple. 5 = light blue, 6 = pink. 7 - orange, 8 = grey, 
9 - dark green. 10 - yellow, 11 = chocolate. 



69 



63 
57 

51 

TOTAL 
CLASSES 39 
IJIJII 

N = 70 33 
27 
21 
15 
9 
3 



21 

CLASS I 
N-25 9 

3 



21 
15 
9 
3 



CLASS II 
N = 22 



CLASS III 
N = 23 



21 
15 



1 2 3 4 5 6 7 8 9 10 11 12 



1 2 3 4 5 6 7 8 9 10 11 12 



2 3 4 5 6 7 8 9 10 11 12 



BOOK NUMBER 1 2 3 4 5 6 7 8 9 10 11 12 



Figure 1. Number of Students Completing Books in the Sequence. 
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The test data were analyzed for different purposes, SubGoquen*} 'fcc- 
tions of this report are concerned with these analyses and a discussiorv 
of the possible implications for publication of the reading proqr-am. 

Investigation of the Standard and Reduced Color Version 

Purpose of the Study 

Color-coding for this program was originally conceived by its authors 
as a prompt to aid children in decoding words. It simplifies an aspect of 
English which is confusing to beginning readers; namely, the fact that the 
same letters may represent completely different sounds or phonemes, and 
thai different letters may represent the same phoneme. Color-coding the 
vowels so that a given color prompts an association between the phoneme 
and however many different visual representations it has allows for a 
rapid increase in vocabulary. Making available the several spellings of 
each sound element introduced builds initial vocabulary much sooner than 
either a traditional phonic system (where there is control which limits 
the words used to ones in which each sound is associated with one and 
on ly one spe I I i ng ) or a si ght-basa I system (where each word is initially 
committed to memory). A more rapidly expanding vocabulary allows for 
more natural language patterns in the text, and a beginning reader should 
come to use additional contextual cues to aid him in the process of read- 
ing. Those students who used the earlier trial editions of this program 
were reading well beyond grade level at the end of grade one. 

In these earlier trial editions of the program, color-coding for 
each element was maintained in the readers until a pre-determi ned point 
in the program was reached. Most often, ten or so additional elements 
were introduced before a color was dropped and all words which used that 



Many of these were consonant elements, of course, so this does not imply 
that ten additional colors were introduced. 



element were color-coded. In the books being tested in ihls study, color- 
coding is controlled on a word-frequency basis within the stories desig- 
nated to use particular colors as outlined in the section entitled Use of 
Color-Coding (pages 2 and 3) where it s+ates specifically that in the SV, 
this control is different than in the RCV. Controlling prompting accord- 
ing to word frequencies led directly to the questions of "how much" color 
prompting would benefit the students and could the students who might 
succeed with less prompting be i dent i f led."' 

Within the context of this reading program, it was hypothesized that 
the SV with its greater amount of color prompting should be easier mate- 
rial for the children than the RCV. More frequent prompting, giving a 
higher probability of success with the reading program (i.e., it should 
be easier to read), should result in significantly better scores on post- 
test measures for the children reading in SV books than for the children 
reading in the RCV books. It was also hypothesized that when the data 
were further sorted on the basis of readiness and 10 scores, it would be 
evident that children who scored less well on these measures and read in 



Initially, we wanted to determine if children could be sorted on the 
basis of their scores on each book-test and then assigned to either the 
SV or RCV for the next book. Could a systematic sort be devised to in- 
crease an individual's chance of success? Likewise, questions might be 
asked such as: Do those children who received "poorer" scores on a book- 
test do better in the SV or the RCV on the subsequent book? 

Several practical reasons made this kind of testing, tracking for each 
book, and retesting impossible. Because the tests were being used for 
the first time, we had no indication of what the range of scores might 
be and therefore no estimate of a reasonable sort on scores. To compli- 
cate it even further, grouDs of children completed any book within a time 
period that varied as much as a month, so that by the time all children 
had been tested on any one book, it was too late to process the informa- 
tion and then assign children to SV or RCV books according to their 
scores. And within each group, the number of children was too small to 
divide according to their scores into two groups which would then again 
have to be divided, half to the SV books and the other half to the RCV 
books. Consequently, although the actual inquiry was quite different 
from what had originally been conceived, it lies closer to the individ- 
ual tracking that might be possible in a regular classroom setting. 



the SV would do better than their RCV counterparts. The present '-.'jJv 
was carried out to probe these two hypotheses with the goal of boMV) able 
to establish tentative criteria for student assignment to either 3V or 
RCV for future use of the progrv^m. 

In reviewing the data analysis and discussion that follows, one should 
be constantly aware of the fact that this was an exploratory research proj- 
ect: the results and conclusions are therefore very tentative and merely 
indicate trends which ought to be further researched. They do not altempt 
to prove any hypotheses with statistical evidence. 

Popu I at ion 

The children tested throughout the project are fully described in the 
Summary Report (Frankenstein, 1971) and are there referred to as the chil- 
dren from City B in Classes 3, 4, and 5. 

Method 

Children were given reading instruction by their regular classroom 
teacher using the LRDC Beginning Reading Program. All three teachers 
grouped pupils for instruction, and each group typically had one "read- 
ing circle" lesson each day. The pace was determined by the teacher and 
varied from teacher to teacher. (See Figures 2, 3, and 4.) 

After completing Book 3, children within each reading group were ran- 
domly assigned to do their subsequent reading in either the SV or the RCV 

g 

books. Each student had his o\^n book (SV or RCV) in which to do assigned 
reading or to work with during "reading circle." Pictures and text were 
the same in both versions. The SV books had a red spiral binding, and the 
RCV books had a b I ue spiral binding. 



One important exception to this assignment is the case of seven students 
in the "top" group in Class II who all elected to read in the RCV books 
and were allowed to do so. Some analyses are noted as including these 
subjects and some excluding them. 
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The Metropolitan Readiness Test, the Murphy-Durre I I Test, and the 
Pi ntner-Cunni ngham Test were given in September by two members of th ' > 
project. Tests for each book were devised and administered as described 
in the section Testing Program, beginning on page 4. At the end of the 
year, the following tests were also given: Stanford Achievement Test, 
Fry Word List, and Gray Oral Reading Test. 

Results 

T- tests of the differences between the SV group and RCV group are 

presented in Tables 3, 4, and 5. (Tables 3-A and 5-A present identical 

information on the groups with the seven children from Class II removed 

from the analysis.) There are no statistically significant differences 

on readiness measures (p < .05), nor even any consistent differences 

(Table 3) when all students are included in the emalysis. When the seven 

students are eliminated from the analysis, the Learning Rate Test (Murphy- 

g 

Durrell) does show a significant (p = .029) difference. All post-test 
results favor the RCV group, three of the nine book-tests indicate a sta- 
tistically significant difference (Table 4), and certain sub-tests on the 
Stanford Achievement Test also favor the RCV group (Tables 5 and 5-A). 

The data were further analyzed'^ in a search for some definable sub- 
group of the population reading in the SV bocks who consistently performed 
better in the tests than their counterparts in the RCV group. The SV and 
RCV groups were divided into sub-groups according to the measures recorded 
for their \0, their knowledge of phonemes, and their knowledge of letter 
names. Divisions were as follows: IQ (Pi ntner-Cunni ngham Test — scores 
of 50-89 assigned to the low group, and scores of 90 and above assigned 
to the high group); phonemes (Murphy-Durre I I Test — scores of 26 and under 



This is most peculiar since one would expect that dropping the seven 
top students would decrease the average learning rate of the RCV group 
rather than increase it. 

; '^For this analysis, the seven students in the top group of Class II were 

el i mi nated. 

ERIC 16 



0) 

u 
c 
ra 
o 

'E 

CO 



in 
in 
I— 

6 

ti 

a 



00 

6 

n 

a 



eg 
eg 

6 



o 
k» 
a 
a 

n 

O 
O 

o 



o 
o 
o 



in 
o 



0) 
00 

o 



CO 



00 

o 
6 



0) 



o 

5 



in 

0) 



00 

o 

00 



00 

6 



o 

0) 
CO 



00 
CO 
00 

6 



0) 



o 

0) 
0) 



00 



q 

0) 

in 



q 
oi 
in 



q 

0) 

in 



0) 

in 



0) 

in 



q 

0) 

in 



q 

0) 

in 



q 

0) 

in 



q 

0) 

in 



UJ 

(/} 



CO 
0) 

in 
6 



in 
6 



6 



6 



o 
in 



o 



0) 



00 

o 



0) 

u 
c 

0) 



in 

00 

6 



in 
in 
6 



00 

6 



0) 
90 

6 



CO 
CO 

in 



in 



{D 
00 



a 

3 

O 2 



^ o 

0) o 
CO 

6 N 



CO 



t- o 

oi CO 



in 

CO (O 
00 



00 M 

00 »- 

q 00 

00 00 

00 f- 



in in 
in 
CO oi 
CO »- 



OJ «3 

CO »- 



0) 

OJ 00 

in ^ 

0) ^ 



a 

3 

o 

> 

(/} 



00 ^ 
9 in 

t- 00 



CO 00 

01 in 
in CO 

oi 



0) 0) 

00 N 

00 0) 

0) oi 



OJ (O 

oj 5 

OJ V 

CO CO 



o 

q 00 
in 00 

00 



(O in 

in (O 

in in 

^ oi 

00 »- 



0 o 
N cn 

CO ^ 
00 

01 f- 



O 00 

O 00 

q 0) 

^ oi 

CO »- 



CO 
(O in 

N CO 



O 

IX CO 



O 



O 

IX (/) 



O 

IX CO 



o 

IX </) 



o 

IX (/3 



o 

IX (/3 



o 

IX (/} 



o 

•X w 







0) 




c 








ra 


D) 


0) 




OC 


*C 


c 


ra 


ni 


a> 


lit 




o 




a 


k. 


0 


o 


w 
*^ 




0) 









D1 

.s 

*E 



IE 

u 



0) 
X 

a 



CD 
CO 



0) 



0) 

< 



g Q i 

fe ^ I 

c a ;F 

C 3 

a: s 



0) 

E 

ni 



CD 

OC 
Oi 
c 



17 



< 

CO 



< 



2 ^ 
S .E 

a E 

QC — 
m 

c i2 

CD (J 

o *-» 
O c 

0) 

S CO 

^ c 

0) 

s: CO 

> t; 

CO « 

c 

I/) 

a> « 
« .E 

= -D 

Q § 

O ^ 
«/> o 

1^ o 



0) 



c 



a 
o 



a 
2 

o tl 

> 2 
CO 



in 
in 



00 



o 

s 



(O 

6 



0) 
00 
00 



in r- 

N CO 

6 oi 



00 « 
^ in 

r- 00 



o 



Q) c 

c 

ra 0) 

2| 



00 
(O 

6 



6 



6 {>i 



en 00 
o) in 
in CO 



O 



c 
*E 



o 

II 

a 



in 

O) 



in 
o 



CD 
CD 

d 



in n 

in 

6 N 



O) O) 

00 

00 O) 



IX w 



cn 
c 



6 



in 



6 



o 



00 (O 



O 

IX (/} 



0) 

a 
< 



o 
in 
6 



d 



q 
in 



00 



o 



to in 
to 0) 

00 



N O 

q 00 

in 00 

00 



O 

IX t/i 



d 



CO 
00 

d 



q 
in 



in 

00 



N o 

O 00 

^. r 

00 O) 

00 w- 



(O in 
in (o 
in in 



o 

IX (o 



q 
d 



o 



in 



o 
o 
o 



o in 



o o 

f>. O) 

CO ^ 

00 r-* 



IX (/} 



< 



(o =: 

O) 0) 

r- to 

w ^ Q) 

o 9 i 

0) f O 

c a £ 



in 
o 

0) 



o 

(O 



0) 

in 



0) (M 

in 

CO »- 



O 00 
O 00 
O 0) 



o 

IX CO 



0) 

E 

01 

0) 
0) 



O) 

q 
d 



0) 
CO 



q 
in 



in 
o 



o 



^ CO 
O CO 



CO 

(O in 

(O 

CO 



O 

|X w 



Rl 

QC 
c 



on 



TABLE 4 

T-Tests of Differences in SV Group (More Color) and RCV Group 
(Less Color) on Percent Correct for Book-Tests (All Students) 
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assigned to the low group, 27-37 assigned to the middle group, and 58 and 

over assigned to the high group (48 possible)); letter names (Murolw- 

Durrell Test — 29 and under to the low group, 50-44 to the middle nrouD, 

and 4!) and over to the high group (52 possible)).'' Appendix C presents 

I 

the mean scores in pcrcents for these groups on Itook-Tests 4-9 " sub- 
divided into tests of (I) words in context, (2)' words in isolation, .-jnd 
(3) the color association of the vowel when applicable. Mean scores for 
the sub-groups on the Stanford Achievement Test and Fry Word List are olso 
presented in Appendix D, 

Two or three sub-tests for each book (a total of 16) are entered for 
the eight different sub-groups of students (256 mean scores: 128 SV, 128 
RCV). Dividing the students into sub-groups according to their pre-test 
measures of readiness was not a successful approach to isolating any sub- 
group which consistently performed better in the SV books than in the RCV 
books. One might expect that the lower readiness group would perform 
better with materials providing the most color promoting, but they did 
not. 

In order to look for trends which might suggest further statistical 
analysis, the data presented in Appendix C were summarized in Table 6, as 
follows: a was assigned to each SV cell where the mean was at least 
10 percent better than the same group on the same sub-test reading in the 
RCV books, A was also assigned to each RCV cell where the niean was at 
least 10 percent higher than its SV counterpart. Thirty-four plus scores 
are recorded for the RCV group and sixteen for the SV group. In cells re- 
lated to reading sub-tests (i.e., tasks requiring recognition of words in 



These divisions were determined after an inspection of the distribution 
of scores for these children. Due to an error in the computer request, 
one student is omitted from the IQ analysis, one from the phonemes anal- 
ysis, and four from the letter names analysis (two with scores of 45 and 
two with scores of 26). This was not discovered early enough to rerun 
the data, and it can be argued that these sets of missing data on each 
analysis would not significantly alter the data which were only inspected 
rather than subjected to statistical analysis. 

'At Book 10 level, the N is too small to sub-divide and give any reason- 
able data. (See Figure I.) 
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isolation and words in context without a color association), there are 
ii»iriy plus scores for 1he RCV group ana seven for the bV. Tesis ct the 
color association (the recognition task in which all choices are identlcdl 
except for color of the vowel) favor the RCV group in :^ook 6. In -ooks 

7 3nd 8, however, we find nine cells favorinq the ^rouD and only one 
favoring the RCV group. There appears to be a strong trend for the low 
scorers on readiness measures to respond correctly to the color assccic:- 
tion task in Books 7 and 8 (the last four colors in the program) if they 
have been reading in the SV books rather than in the RCV books. (See 
Table 7.) There appears also to be a strong tendency for the high scorers 
to do much better on context items and considerably better on words in 
isolation if they have read in the RCV books. In general, though, for 
both words in context and in isolation, there are more correct responses 
from the RCV group — hiqh, middle, or low readiness scorers. 

T-tests for significant differences between the SV and RCV croups on 
items testing (I) words in context, (2) words in isolation, and (3) words 
with colored vowels were also computed (Table 8). Data on all students 
in both groups are included. Each and every difference that is statis- 
tically significant indicates that the RCV group performs better than the 
SV group. The addition of the seven students from Class II (see footnote 

8 on page 15) increases the mean scores for the RCV group '"^ and may well 
account for the lack of an expected statistically significant difference 
in favor of the SV group on the tests of color association in Books 7 and 
8. (See the last paragraph on page 16.) The significant differences in 
favor of the RCV group include item types of all kinds except the color 
association type. 



It is interesting to note that although there are no statistically sig- 
nificant differences between the SV and RCV groups on their readiness 
measures, when ihese seven subjects are included in the RCV group (Table 
3), it certainly does increase the scores of that group on book-tests. 
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TABLE ? 



Number of Comparisons Apparently Favoring the SV or RCV Groups on Books 4 - 9 



BOOKS 4 • 9 


Breakdown of 16 Items 
Favoring SV Group 


Breakdown of 34 Items 
Favoring RCV Group 


Number of Item 
Types on BookTests 


Context 
2 


Isolation 
4 


Color of Vowels 
10 


Context 
16 


Isolation 
14 


Color of Vowels 
4 


Readiness Measures 
Groupings 

high 


0 


1 




3 


9 




5 




2 


medium 


1 


2 




1 


2 




5 




2 


low 


1 


1 




6 


5 




4 




0 



Discussion 

Our hypotherJs pertaining to the expected superiority of the children 
reading in the SV books (more color) is certainly not upheld by these data, 
and in certain instances, even a null hypothesis of no differences would 
h:^ve io be rejected in favor of the RCV group. For mean achievement, 
classes would do better with instruction in the RCV books, and even the 
groups scorinn low on readiness measures appear to be as well off us i no 
the RCV books except in the tests of color associalion. 

What imolications for the program can he extrapolated from the re- 
ported superiority of the RCV books? An immediate suggestion might be 
that the low scorers on the Pi ntner-Cunn i nqham and the Murphy-Durre I t 
tests would do better in the SV books if, in fact, they had learned the 
color associations better. But, we readi ly reject this suggestion on the 
basis of the evidence that the low scorers using the SV books did, in 
fact, learn the associations better than the low scorers using the RCV 
books. (For results, see Table 7, Color of Vowels, for Books 4-9 and 
Appendix C for Books 6-8.) 
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In Book-Tests ^ and 6, the mean achlevenen-f for the ^"vCV ircuo :is well 
the SV qrouD on context 1 te^^s was better with black print than on those 
i ioi'i'j in color. (jee lable o.) On vt^ose lesu^, n.^ri, me sTjOc-ms v.ci e 
Dor-forminci as well without the prompt, and it is difficult to sj^i^icst that 
cin assiqnment of more color would be of value. However, such results are 
Quite different for E3ook-Tests 7 and 8 where the SV croup and the RCV 
MrouD perform better on context I terns in color. (See Table o.) .vhv? 
F^rhaps because the number of associations is fewer in the former case. 
Books 4 and 6 each introduce only one vowel and retain the five already 
*aught, while Books 7 and 8 each introduce two vowels, as well as r.^iin- 
taining the seven that have previously been taught. In Book-Test where 
two vowels are introduced, three maintained, and two consonants are also 
introduced. At both points in the program, students do better on context 
items in color, and this suggests that some differential assignment r.anip- 
ulating the color prompt might prove worthwhile. This is discussed fur- 
ther on page 30. 

One might also suggest that if less color prompting results in higher 
mean achievement, perhaps no color prompting would yield even higher 
achievement. There is no evidence to support such an extreme posilion. 
The overall success of the program as measured by standardized tests sug- 
gests that the program is extremely effective in City A using only the 5V 
(Table 12, Frankenstein, 1971), and achievement test performance of both 
grouDS in City B is better than might be predicted from the children's 
readiness measures (Table 10, Frankenstein, 1971). 

"How much" color prompting would be most effective remains an empir- 
ical question and is not answered by this research. Other research 
(Anderson & Faust, 1967) indicates the possibilities of an over-reliance 
on prompting and ensuing difficulties. One notices in a brief look at 
the RCV books that the color is noticeably absent for associations which 
have been presented in earlier books, but color is still quite prominent 
for the association being taught. It is possible that the prominent use 
of four colors at one time (which is the usual case for the SV bocks) 
might be interfering with optimal performance. If best guesses are in 
order (and the nature of this research is really to lead to such hypotheses), 
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the hypothesis is now offered that a program whicn wi rhcraws color' pr-r-r- 
inq more rapidly than the SV would be effective with a ncrnial pcou I at i cr. 
of children. A now alternate vorzicn u-T'i-j over le^.-' tc'c^ p^^,... ♦ f r-.. 
either of the current versions might be designed for pupils who r:ivo o.'- 
dence of highly successful progress. Further, the hypothesis is offerei 
that if supplementary readers o^ a remedial nature were Jevised to prcvijt 
further work for chi Idren who are not performing well, these readers a I go 
would increase reading performance. These latter materials are discus'ivl 
later; the following comments refer to the suggested alternate vcrsic-.s 
of the readers. Data supporting the suggestion are also discussed. 

The early book-tests (or a test devised specifically foi- sortinc: 
students) could provide evidence of mastery through Book 5, and might 
track highly successful individuals into a new RCV of the readers. This 
new RCV would be used only by these advanced students and would be con- 
structed for Books 4 through 9. (Book 4 is usually introduced in Dece^-.ber- 
or January.) In the new RCV, the teaching pages and the stories would uso 
color for the new element as they now do. However, the earlier color^3 
would be dropped completely except for the first instance of a word never 
before used. In any such "new" words, color could be used for only the 
three most recently taught colored elements. This would be in accordance 
with a revised overall color-drooping schema described in the next two 
paragraphs. The result would be a version to be used by highly successful 
students and it would have slightly less color than is now found in the 
RCV. 

A new SV might well more closely approximate the present RCV, but 
the evidence from City A (Table 12, Frankenstein, 1971) where experienced, 
enthusiastic teachers supportive of the program elected not to use the RCV 

at all, suggests that the SV is quite appropriate, as is, for their punM^. 

14 . . 

who were retained in the program. It also suggests that when revisinq 

the SV by deleting color, caution needs to be exercised. 



It is reported in that document that teachers administering the pronram 
decided to place some children in an alternate program after completion 
of the sixth reader because they required "enrichment and review as 
opposed to new materials." 
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Thorefore, now TV is suqr^ested which wou I J keec " '.'rr-e of 1he oxten- 

^ivo color DTon^ntinn of the present SV, but manicularo the withdrawal of 

rhe nrorr^'Dt for nreviouslv tauaht colors more ranidiv, '-Pa-cific prooosals 
for a new SV are cis follows: 

1. The teaching pages would remain as they are now. 

2. The color prompting wo-jld be retained over fewer ^.torics 
(see Figures 5 and for conriDarison of current version 
to proposed version) so that, even though first r^tories 
for each phoneme would still appear with all colors beinc; 
carried at that point, there would still be fewer colors. 

5, Color prompting for the second stories would be retained 
according to the present criteria — that is, color would 
be dropped from words which had appeared previously at 
least five times with the color prompt, with the excep- 
tion of the association being taught, and that new ele- 
ment would retain its color throughout the second story. 

As early as the test for Books 1-2, there is evidence (presented in 
Table 9, page 36) that the students had not mastered the /e/ to £ asso- 
ciation, nor the /iy/ to e_a association, and in Book 3, the same is true 
of the /ay/ to iCe and /ey/ to ay_, £i_, and aCe assoc i at i oris . Individual 
tracking at this point in the program is suggested for early remedial 
training. A test could be devised (the same test referred to on page 29) 
to precede reading in Book 4 and new instructional material (Book A and 
Workbook A) made available for those students who had not mastered the 
associations. Book A would use only the elements taught in Books I, 2, 
and 3, and the color prompt would have to be carefully manipulated. The 
extent of prompting used should be discussed by the researchers/authors, 
and it may be decided that four of the five colors should be withdrawn 
from all but new vocabulary before introduction of a sixth color in E^ok 
4. The two associations using the letter £ (/ae/ in map and /ey/ in m£de, 
ma i d , may ) and the two associations using the letter £ (/e/ in bed and /iy/ 
in bead ) would be contrasted extensively, while ]^ as it represents /ay/ 
(IJ^fe) would be firmly established before the introduction of the pink 
for /i/ (hit) in Book 4, 
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The consonants ni,t.s,n, and d are taught prior to the first story in Reader 1. 
Total number of stories before color is withdrawn. 

Dark blocks represent vowels introduced in black print and not color-coded. 



Figure 5. Suggested Changes in Sequencing Color (Compare with Figure 5 A). 
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^ The consonants m. t. s. n. aif)d d are taught prior to the first story in Reader 1. 
^ Total number of stories before color it withdrawn. 

^ Dark blocks represent vowels introduced in black print and not color*coded. 



Figure 5-A. Color-Coding Used for Each Vowel Phoneme (Frankenstein, 1971). 
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The same suggest ion is made for a fast and supp I emen tr^ry rencj'::! 

materials to cover f^oks 7 and 8. There is ample evidence ttijT ihis is 

I 5 

also a difficult point in the program and these aJditional ri.i to'- 1 1 •■ 
ourjht to he mr^dp a\'3i I able. 

All of these materi a I s , if constructed, should be tried in Ine cIjs"-- 
room and a report made of their effectiveness. Classrooms of 25 tc '^0 
students would probably find it necessary to buy only a small number ot 
copies of the new RCV for advanced students (8-10 copies), 18-22 copies 
of the SV, and 8-10 copies each of the new sudd I ementary remedial readers. 
Readers A and B. 



Analysis of Elements Taught 



PurDOse and Procedure 

Test data have also been analyzed to determine how well individual 
elements in the program were learned by these same children. The instruc- 
tional method, the children, the materials, and the tests are all aesc^-ibea 
earlier in this report. The book-tests were re-analyzed and the oercent^ne 
of correct responses to individual items tallied. The items Dertaininn to 
each phonic element were organized according to: 

1. The spelling (graphic representation) for that element. 

2. Whelher the test was a recognition task (words in iso- 
lation) or context reading. 

3. Whether the print was black or color-coded. 



Analysis of correct responses to specific elements indicates that the 
ar (dark), ir (dirt), and ui£ (turn) in Book 7 are troublesome, as are 
aw" (cTaw) and" a_ Tba \ I ) in E3ook 8. 

'Elsewhere in this report (page 58), a resequencing of Books 8 and 9 is 
suggested, and it is assumed that the test and materials would relate 
to the new sequence. 



33 



Be^oro aiscus5ing the results of this analysis, some conr^ents on the testr^ 
and the tost inn proa ram are in order. 

The exc^miner was in the school only two or three days a week, and he 
T* f» I I ovi'(^d to oh^or^'p I a^*-* rcc^ i n*". "^r'.'ct i cn I"? ^ry y te*^*^ ^ i '~ ^^-j'^npr^ 

He had to rely on the three teachers to inform him as to when each child 
or qroup of children should be tested. Consequently, some children were 
inadvertently missed for some book-tests. 

The tests were very difficult for many children, particularly at the 
beginning of the program. There is clear evidence that children tended 
to mark the first choice for many items, and one can argue that if the 
tests had been easier, or the children's mastery better, such would not 
have been the case. The length of the tests also contributed to iheir 
difficulty. Since poor performance resulted, in part, from the extended 
length of the early tests, the tests were shortened, thereby sacrificinq 
any built-in check on reliability. Comparisons between context items 
with answer choices printed in black and context items with answer choices 
printed in color probably do not constitute a valid test of the usefulness 
of color. Many students were unable to read the context necessary to guide 
their decisions about appropriate choices. 

Book-tests indicate how well a child is performing using black print 
when, in fact, the program carries the color-coding for at least another 
two readers. Therefore, the tests should not be construed as "mastery" 
tests, for that would be incompatible with the color-coding technique and 
scope. 

Not until Book-Test 4 did the researchers zero in on a reasonable 
pattern for test construction. This is found in Appendix A. 

The children's tendency to select the first choice among alternative 
answers yields an over-estimate of the correct responses to some elements. 
This is the case on the items where the first choice is the correct 
response. 

r 3 
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Resu Its 

A complete tally of all item tyoes, the order in which ^he ?il^orr- 
tives appeared in the tests, and the percentage of correct respcn'^r-: r 
been prepared and i s on f i I e at the Learning Research and Develop-er* 
Center, Table 9 abstracts from that tally the results reported for ele- 
ments tested in isolation and also printed in black. This recognilion 
task is used for comparison because it is the only item type thai i -3 useJ 
consistently throughout the program for all elements. Words used to te'.t 
the elements are separated into "familiar" and "new" words, "Familiar" 
is the designation for words used in the program ten or more times, and 
"new" designates those words generally not used at all in the procram. 
In some instances, "new" words have been used once or twice in the pro- 
gram because all permissible words were used in the program. Where more 
than one word was used to test one spelling of an element, the results 
are averaged, and the mean percent correct is entered in Table 9, 

Elements taught which received less than 70 percent correct responses 
on words which appeared in the program are indicated except for consonant 
blends which were not specifically taught. Most errors are evident in 
Book Tests 1-2, 3, 7, and 8 and on the /uw/ associations in Book II, 

Although not all elements are tested using new words, in general, 
the same elements which received a low percentage of correct responses 
on "familiar" words received a low percentage of correct responses on . 
"new" words also. In addition, elements with low scores on "new" words 
are: /iy/ spe I I ed y_ i n Fanny, /ar/ spel led er in fern , /Dy/ spel led oy 
as i n toy, and /j/ spel led ^ as i n Jump , 

To summarize: 74 associations (excluding blends) were tested in 
"familiar" words, and 24 of these had less than 70 percent correct re- 
sponses. Among the 74 were 53 associations tested in both "familiar" 
and "new" words; 19 of these had less than 70 percent correct responses 

in "familiar" words. Other than these 19, 4 phonic elements had less 

than 70 percent correct responses in "new" words. 
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TABLE 9 



Percent Correct Responses to Elements in Words Used in the Instructional 
Materials ("Familiar") and to Words Not Used or Used Only Once or Twice ("New") 



Book 


Niinib6r of 
Subjects Tested 


F lament 

Tested 


Spelling 


% Correct 
"Familiar" Words 


Responses 
"New" Words 


1 &2 


69 


/ dt/ 


a 


74 




1 & 2 




Iml 


m 


678 


75 


1 & 2 




t\l 


t 


91 




1 & 2 




lil 
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96 
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68 




1 &2 




/n/ 
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67 




1 & 2 
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e 


58'> 
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str 




55 



Less than 70 percent correct respon>;es to "familiar" words. 
Less than 70 percent correct responses to "new" words. 
Word used only four times. 
Word used only three times. 
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TABLE 9 {continued) 



Book 
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Less than 70 percent correct responses to "familiar" words. 
Less than 70 percent correct responses to "nev/' words. 
Word used only four times. 
Word used only three times. 
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Pi scuss ion 

Certainly one can state from these results that associations of ele- 
ments within words are learned rather than sinhi- words. This is supoorted 
by the magnitude of correct responses to elements tested in "new" words 
whenever there was evidence that the "familiar" words for that element had 
been learned. The original philosophy and theory under lyinq the readina 
system appear to have been supported in practice. 

The number of associations that did noi receive over 70 percent cor- 
rect responses on "familiar" words is discouraging, but we must remind 
ourselves that these tests preceded expected mastery in the program. (See 
pat.ie 34, third paragraph.) Nevertheless, several suggestions arc made for 
reducing the number of incorrect responses. The supplementary remedial 
materials for Books I through 3 and Books 7 and 8 are described earlier 
and their implementation might effectively improve instruction on five 
elements in Etooks I, 2, and 3, and eight elements in Books 7 and 8. 

None of the three spellings of /uw/ (blew_, blue_, and ru_le^) yielded 
satisfactory test results. Although the evidence from oral contextual 
tests supports the dropping of color-coding after Book 8, it might improve 
performance on this element to color-code it for a brief period. It would 
conslitute a worthwhile part of a study involving the published materials. 
A very dark blue, almost black, is suggested for use in coding that ele- 
ment for eight stories. 

The concentration of four vowel elements in Books 7 and 8 with only 
one additional consonant may account for some of the problems in those 
books. Since Book 9 introduces three consonants and no vowels, it is sug- 
gested that the sequence of Books 8 and 9 be changed to: /o/, /aw/, /g/, 
hi , and then /w/ in the position it now holds in the sequence. Book 8 
could be extended to include the four newly sequenced elements and /w/ 
would be the first element in Book 9 which, in turn, could be extended to 
include all of Book 10. Book II, then, would become Book 10, and Book 12 
would become Book II. (See Figure 5, page 31.) Stories would have to be 
rewritten for the new Book 8, and they would have to be constructed in 
such a manner as to give more practice with the vowel phonemes of Books 7 

3^^ 



and 8. Such pacing seems to be effective in earlier segments of the pro- 
gram and might we I I be an improvement through Books 7 and 8. 

Investigation of Usefulness of Contextual Cues 

Purpose 

The testing program was also initiated for the purpose of investi- 
gating the adequacy of syntactic and semantic cues for reading words con- 
taining elements which have not yet been taught. The question of *'How 
much phonics and for whom?" will probably not be answered for some time 
to come. However, the somewhat simpler question of "How soon does phonic 
teaching provide enough context to enable readers to expand their repertoire 
of phonic associations without specific teaching?" can at least be explored 
in the context of a carefully controlled "decoding" program such as this 
one. Is there an optimal point in the program when rost readers find con- 
textual I cues sufficient, or does that point differ considerably from stu- 
dent to student? Has the color prompting in this program been terminated 
at that point, if it exists, or where would it be best to terminate color- 
coding? These and related questions are discussed and tentative hypotheses 
drawn from the analysis of the test data. 

Tests 

Children were required to orally read sentences as a pre-test for 
each book. Words used in each sentence contained only elements that had 
been taught, except one "target word" which contained one, and only one, 
untaught element. Pre-tests are presented in Appendix B, and the untauoht 
element in the target word is underlined for purposes of this report only. 
The tests were administered to the students prior io their beginning each 
new book, and each was re-administered after the book had been completed, 
e.g., the tests of /b/ and IM were given both before and after Book 4. 



f>cor i ng 

In order to be sure that we were, in fact, testinq the adequacy of 
the contextual cues, it was necessary to devise a sclieme that would score 
only those target words in sentences where the student knew the surround- 
ing words. Therefore, records were kept of the reading of the entire sen- 
tence, and only those responses to target words by individuals who read 
most of the rest of the sentence were analysed. The criteria to be met 
for "scoring" were as follows: 3 correct words necessary if 3 other-than- 
tarqet words were in the sentence (3/3); 4 correct if 4 other-than-tarqet 
words were used (4/4); 4 correct if 5 other words were used (4/5); and 
5 to 8 correct words necessary when 6 to 9 other-than-target words were 
in the sentence (5/6, 6/7, 7/8, and 8/9). 

Res u Its 

Table 10 presents a summary for each element giving the number of 
students tested, the number of students who actual ly met the above stated 
criteria for "scoring" for each sentence, and the percent of correct re- 
sponses for both pre- and post-measures. The number of children tested 
varied due to the difficulty in finding a convenient time for testing. 
In all cases, pre-tests should have been administered after the child had 
completed one book and prior to his beginning work in the new book whici*) 
introduced the elements to be tested. However, after completing Book 5, 
for instance, only 54 children were tested, although 65 actually completed 
the book; II therefore had already worked in Book 6 before the pre-test 
could be administered. The percent of correct responses refers only to 
those children who met criterion for "scoring" and indicates what per- 
centage of them read the target word correctly. 

I nd i vi dua I Resu I ts 

Data on individuals are fragmented both because the test data are in- 
complete and because many individuals might have met the criteria for 
"scoring" on one book and failed to reach it on the next. Table II indi- 
cates the point at which individuals began to read words with untaught 
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TABLE 10 



Responses to Words Containing Untaught Element When Read in Context 



Pre-Tost 


Untaught Children 


/ Children Who 


Total Children 


% Correct 


% 


Correct 


for Book 


Element Tested 


1 Completed Book 


Who "Scored"' 


on Pre-Test 


on 


Post-Test 


4 


b 


baked 


39/65 


23 


34.8 




55.5 




i 


sit 


39/65 


30 


10.0 




75.0 




i 


it 




30 


20.0 




80.0 


5 


P 




54/65 


45 


86.7 




97.6 






pill 


54/65 


37 


81.1 




100.0 




h 


high 


54/65 


45 


71.1 




97.6 






had 


54/65 


37 


86.5 




100.0 


6 


oa 


boat 


59/64 


24 


62.5 




100.0 




tr 


tree 


59/64 


40 


77.5 




88.1 




sh 


dish 


59/64 


51 


37.3 




83.7 


7 


0 


dolls 


54/58 


49 


51.0 




96.3 




er 


letter 


54/58 


44 


59.1 




79.4 




ir 


dirt 


54/58 


38 


55.3 




69.7 




er 


dark 


54/58 


45 


46.7 




69.2 


8 


ou 


house 


54/50 


40 


55.0 




100.0 




a 


ball 


54/50 


31 


45.2 




82.8 


9 


8 


gate 


48/48 


37 


100.0 




94.3 




w 


week 


48/48 


44 


100.0 




97.5 




th 


bath 


48/48 


34 


79.4 




97.2 


10 


u 


run 


46/46 


38 


97.4 




100.0 




ch 


cheese 


46/46 


37 


91.9 




100.0 




oo 


book 


46/46 


44 


84.1 




100.0 




00 


food 


46/46 


41 


87.8 




100.0 


11 


ew 


new 


25/25 


24 


91.7 




100.0 




u 


tune 


25/25 


22 


36.4 




81.8 




wh 


wheel 


25/25 


21 


90.5 




100.0 




oi 


noise 


25/25 


22 


72.7 




100.0 




V 


visit 


25/25 


25 


76.0 




100.0 




V 


yells 


25/25 


13 


84.6 




100.0 


12 


u 


music 


22/22 


16 


50.0 




100.0 




z 


prize 


22/22 


17 


100.0 




100.0 




X 


fox 


22/22 


19 


100.0 




100.0 




qu 


quiet 


22/22 


20 


45.0 




71.4 




i 


iet 


22/22 


16 


100.0 




100.0 




Ph 


telephone 


22/22 


22 


77.3 




100.0 




c 


cents 


22/22 


21 


85.7 




100.0 




g 


cage 


22/22 


18 


38.9 




57.2 



*See page 40 for criteria for "scoring." 
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elements, and also the point at which they consistently did so. Students 
were initially given a and entered in Table II at that point where 
they achieved 75 percent correct responses on target words. Sixty-five 
students were tested and there are data on 51 of these who "scored" (i.e., 
could read the context surrounding the target word). Twenty-six of these 
51 students began to read quite consistently at least 75 percent of the 
words containing untaught elements. These students are designated with 
an asterisk at that point where they did make at least 75 percent correct 
responses for each and every successive book and may be said to be "using 
context. " 

Figure 6 gives a cumulative record of the number of individuals 
reaching the criterion for "using context" to decode untaught elements 
at pre-test level for each book. Beginning with the pre-test for Book 6, 
5 subjects were "using context," and by the Book 9 pre-test, 22 subjects 
were "using context." Figure 7 indicates that most of the students who 
met this criterion for "using context" to read words containing untaught 
elements completed reading at least 10 of the 12 books in the program. 
In most cases, it is true that the teachers had placed these individuals 
in the top two of three reading groups (or the top three of four in the 
case of Class III), and one might expect that students who were able to 
"use context" would also be able to progress through the program. How- 
ever, the converse of that statement is not true. As Figure 7 indicates, 
II students who never did quality for the "using context" classification 
did read through Book 12 in the program. 

Results of Group Data 

Figure 8 gives the percent correct on both the pre-test (before an 
element is taught) and the post-test (after a book has been completed). 
On the pre-test for Book 5, students seemingly did make use of context 
and give correct responses to the target words in the sentences. In fact, 
elements in Book 5 were responded to correctly more frequently than ele- 
ments in Books 6, 7, or 8. After Book 8 had been completed (II vowels 
with their various spellings and 14 consonants had been taught through 
Book 8), the percentage of students able to read words ccyitaining untaught 
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Figure 7. Point in Program (Book Level) at Which Each Individual Was 

"Using Context'' Contrasted with His Final Book Level for the Year. 

Note.-Fourteen individuals who only went through Book 10 
were "Using Context/' two of them by the 5th reader, 
one by the 7th reader, two by the 8th reader, etc. 
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elements increased greatly. The pre-tests for Books 9 and 10 indicate 
that words containing new elements imbedded in context could be read by 
most of the children at that point in the program. The post-test results 
also take a dramatic turn indicating mastery after Book 8, but pre- to 
post-test improvement was less than earlier in the program with some no- 
table exceptions. In Books II and 12, there is a great variation as cer- 
tain individual elements were significantly poorer than the rest of the 
group. In the pre-test for Book II, the word tune , and in the pre-test 
for Book 12, the words mus i c , qui et , and cage received relatively few cor- 
rect responses, while the other ten words had many correct responses. 

Pi scuGS i on 

The results tallied for individuals support the evidence from group 
data that there is a tendency for most students who are going to use con- 
text to decode untaught elements to do so at the end of Book 8. Ninety- 
nine percent of the students who eventually did qualify met the stated 
criterion at this point. V/hi le 42 percent met the criterion earlier in 
the program, it seemed to be a very individual phenomenon. The results 
charted in Figure 7 prompt us to conclude that it certainly is possible 
to be a "good reader" in terms of the expectancies of this program and, 
at the same time, not use context to read words containing elements that 
have not been taught. Almost half of the students not "using context" 
read through Book 12. However, all those who did "use context" were 
"good readers" in the sense that they progressed through a greater amount 
of material in the program. Only one student "using context" did not pro- 
gress through Book 10, whereas nine of the students not "using context" 
did not progress through Book 10. Since the program has a very strict 
vocabulary control, emphasizes decoding, and makes no attempts to teach 
a child to use context, a greater exposure to other reading materials 
(such as library books) might alter these results considerably. Further 
study of the records might generate hypotheses pertaining to the charac- 
teristics of individual learners, and one might also speculate about the 
differences as a result of different teachers, but such analysis is beyond 
the scope of this report. 
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Further Inspection of the data and attention to the individual items 
on pre-tests for Books II and 12 show that the items with fewer correct 
responses are not easily accounted for. When we compare the items re- 
ceiving a very high percentage of correct responses with the items for 
the target words tune , rnus_i_c, qui et , and cage, the larger number of errors 
does not appear to be a reflection of the frequency of the target word, 
the position of the element in the word, the number of words preceding 
the target word in the sentence, nor the grammatical function of the tar- 
get words. (See Table 12.) 

In view of the post-test results (Table 10), one might also hypothe- 
s i ze that and the £ = /j/ associ at i on are d i f f i cu 1 1 el ements that need 
more attention in the program. This contention is not supported by the 
data previously presented in Table 9 on page 36, where it is recorded that 
these elements received 100 percent correct responses on the Book-Test 12 
recognition task of "familiar" words ( giant and quiet ) , and ICQ percent 
and 89 percent respectively on the recognition task of "new" words ( gen- 
eral and questi on ) . Many of the students who were doing exceptionally 
well with the target words on pre-tests for Books 9 and 10 failed to read 
the words tune , music, qui et , and/or cage in the context of the sentence 
presented before the elements were taught, thus disqualifying them from 
our category of subjects "using context" (Table II). Another tentative 
hypothesis can be made that the sentence itself, in each case, really does 
not provide an adequate prompt for those particular target words. Such a 
hypothesis would have to be tested using other contexts. The results of 
the tests on these four words do not preclude our observation that there 
is a marked increase in the use of context beyond Book 8. 

The program authors' earlier decision to drop color-coding beyond 
Book 8 is reinforced by this exploratory testing and the informal analy- 
sis of both the group data and inspection of individual children's records. 
There is strong support for the notion that many students do make profitable 
use of semantic and syntactic cues by the time they have completed Book 8. 
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Summary and Conclusion s 

Suggestions to the Authors and Publishers 

The following suggestions for the publication of the Beginning Read- 
ing Program are supported by the data analysis of the testing orogram 
carried out in City B during the 1969-70 school year. The research was 
exploratory and the results not definitive in every case, so thct the sug- 
gestions s'^ould be construed as Just that— suggest ions . Reference is made 
to the SDeo^fic section of the report in which each suggestion is intro- 
duced and data presented for its support. 

1. Two versions of the program are feasible and practical if 
students are tracked at the end of Book 3 and only re- 
tracked if and when the teacher has evidence that the stu- 
dent does need more (or less) color prompting. These two 
versions would be somewhat different from the present ones 
and are described on pages 29 and 30. 

2. Two supplementary remedial books, one to follow Book 3 
when necessary, and one to follow Book 8, ought to im- 
prove the program. Appropriate tests to indicate which 
children need the additional materials would also have 
to be devised. (See page 30.) The test devised to fol- 
low Book 3 could likewise be used to track advanced stu- 
dents into an alternate version, RCV (less color prompt- 
ing), as in ( I ) above. 

3. Tests of the oral reading of sentences indicate that, in 
general, after students have successfully completed Book 
8, they are able to use contextual clues as wel I as phonic 
instruction to learn new elements. This finding supports 
the procedure of printing new phonic elements in black 
after Book 8. (See Discussion on page 48.) 
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4. Analysis of the students' responses to particular ele- 
ments indicates certain weak points in the program. 
Suggestion (2) above should help to alleviate some of 
the less-than-successf u I learning, but a new sequence 
for Books 8 and 9 is also suggested. In effect, it 
would intersperse the four vowel elements in Books 7 
and 8 with tfie three consonant elements now taught in 
Book 9. (See the last paragraph on page 38.) 

5. The vowel element /uw/ as in blue, blew, and r ule is 
not learned satisfactorily. In opposition to the evi- 
dence supporting (3) above, it is suggested that a 
color (dark blue) be used in the new Book 9 for this 
element on a trial basis. (See pages 31 and 38. ) 

6. The revised program should be tested by a number of 
teachers using the program in 1971-72, the data col- 
lected and analyzed by the publisher, and a report of 
these data made available to the public upon request. 



54 

52 



Addendum A: Test Revisions 



End-of-book tests were devised by Herbert Simons (Harvard Graduate 
School of Education) and the author of this report which tested the Be- 
ninning Reading Program in City B throughout the 1969-70 school year. 
Copies of these tests are on file at the Learning Research and Develop- 
ment Center, University of Pittsburgh. Appendix A presents the guidelines 
for test construction that were worked out after trial of the first two 
tests. These guidelines were used for Book-Tests 4-12. 

Results of the use of these tests and implications for publication 
are discussed in detail earlier in this report. Following the year of 
testing completed by Herbert Simons,'"' the tests have been revised by Mr. 
Simons and this author. Revisions on rhe tests have been designed to make 
the test useful as a tool for classroom teachers rather than as a research 
instrument. Consequently, the rationale un^Jerlying item selection and lest 
format is quite different from that which pertained to the original tests. 

Length of Test 

During the testing program in 1969-70, the tests were administered to 
groups of chi Idren, and it was evident that the tests, particularly the 
early ones, were too long. The decision to construct tests that v/ere much 
shorter and therefore more practical underlies many of our other decisions. 

Elements Tested 

In the research version of the test, we attempted to test every ele- 
ment, and many elements were tested in several positions within words. In 
the revised version, again, every element is tested, as well as every 
spelling presented in the program for that element. However, not all 



Grateful acknowledgement is also given to Roselyn Frankenstein (now at 
the Massachusetts Department of Education), who worked with Mr. Simons 
and the teachers throughout the year. 
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elements are tested in various positions in the word. An argument can be 
made that if a ch i I d "knows" a grapheme-phoneme correspondence, he wi I I 
**know" it in any position of words. An analysis of correct responses 
made on those elements tested in both initial and final position (when 
the frequency of use of the word in the reading books and the position 
of the correct alternative on the test are simi lar) reveals that this was, 
in fact, true for the children tested (Table 13). If there had been a 
large discrepancy between the elements in initial and final positions, 
several hypotheses would have to be offered to explain the phenomena and 
then a decision made as to whether or not both positions should be tested. 
As it is, the decision is an easy one, and we do not include items which 
test the elements in final position except for t, £, and £, where the 
book-test would otherwise be extremely short. 

Words Used to Test Elements 

Since the test should serve as a diagnostic tool for teachers, giving 
an indication of knowledge of the elements taught rather than knowledge of 
words, the revised version contains only words not included in the reading 
program or those used only once or twice. 

Tasks 

I. The multiple-choice recognition task is again used to test 
the elements in words in Isolation. It is perhaps easier 
for the students than an oral reading task, but certainly 
it is more practical for classroom use. The alternatives 
are printed in black, both for economy in printing and 
for testing the student's transfer from color-coding to 
regular print. Because the test is printed in black, it 
might be better if the test were not administered until 
the end of the book following the one which introduces 
the elements being tested. The test for Book 3, for in- 
...... stance, would be administered when the student completed 

Book 4, and the transfer from color to black would more 
likely have occurred. 
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The recognition task used to test the association of color 
to its appropriate sound is also included. Thus, if sup- 
plementary or subsequent materials in the program make use 
of color, the teacher will know whether or not the child, 
in fact, does have the correct color-sound association. 

Items using the cloze technique test the student's ability 
to (a) decode words in a sequence, (b) remember the words 
and be able to use them as contextual cues to identify an 
appropriate word to complete the sentence, and (c) recog- 
nize and select an appropriate word from among alternatives 
presented. Since the recognition task (I above) will also 
provide evidence as to whether or not a student is able to 
recognize an appropriate word, the cloze items are designed 
more io determine his ability to use context. Thus, dis- 
tractors are offered that are visually and auditorily less 
similar than those in (I) above. They also are real words 
which, if used, result in a meaningless sentence. The re- 
vised "cloze" part of the test is more a test of compre- 
hension than the original version. 

Si nee Task 3 is designed to test the students' abi I ity to 
use Cv.ntextp these items, in general, use only sentence 
patterns with which the children should be familiar. How- 
ever, the structures of the sentences found in the first 
book-tests are simpler than those in later book-tests 
where prepositional phrases and subordinate clauses are 
used. Each book-test does have one four-word sentence 
with the pattern: noun-verb-object. The number of words 
used in the other sentences increases from four or five 
words in Book-Test 4 to six or seven words in E3ook-Test 12. 

Task 3 might also be constructed in color and presented as 
the fourth part of the test. Direct feedback would then 
be given as to the usefulness of color to the student. 
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Pi stractors 

Distractors for Task 3 are described above. Distractors for Tasks 
I and 2 follow the guide used In the original construction (Appendix A). 

Position of Correct Responses 

The data from the original tests clearly indicate a first-position 
preference. This author has other evidence that words presented hori- 
zontal ly also result in first-position (left) preference. Vertical align- 
ment of alternatives does make it easier for the student to see the letter 
contrasts in words and should, therefore, be helpful. For the recognition 
task, we have no alternative suggestion for aligning alternatives, but we 
have attempted to extinguish this position preference by placing only a 
very few correct choices in the preferred first position. A publisher may 
want to consider other formats, such as listing the choices above the sen- 
tences in context items, or staggering them below the blank space in the 
f ol I owi ng manner : 

The cat chased the . 

mouse house 

morse hole 

There appears to be no evidence that any of these formats is better than 
any other. 

Admi nistrat i on 

The test directions are included and they proved quite practical for 
the original version. The picture prompts for locating the correct item 
may be dropped after the first two tests. Tests should be administered by 
the teachers, who should then refer to the analysis of errors found with 
each test. 

A complete guide of the elements being tested in the revised tests 
for Books 1-12 is found in Appendix E. 
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APPENDIX A 

Patterns for Constructing Tests for Books 4-12 



1. Tests of words in isolation, testing vowe I s . 

a. Three distractors. 

(I) Only vowel changes. 

b. One-half of items are taught frequent words, one-half new words — 
Thorndl ke-Lorge AA or A. 

2. Tests of words In Isolation, testing consonants . 

a. Three distractors. 

(I) Only consonant changes. 

b. One-half taught frequent words, one-half new words. 

3. Tests of words In Isolation, testing color assoc i at i on of vowels. 

a. Three distractors. 

(1) Same as correct word except vowels are In an appro- 
priate color. 

(2) Colors are from previous book and other elements in 
book Just completed. 

b. Taught words, low frequency In readers and workbooks. 

4. Tests of words in context, testing vowe I s ("Cloze"). 

a. Same stimuli and distractors as in (I.) above except order of 
the items is changed and order of distractors is changed. 
(Beginning with Book 10, distractor order is also held constant.) 

b. Sentences use words taught in previous readers. 

5. Tests of words in context, testing consonants . 

a. Same stimuli and distractors as In (2.) above except order of 
items and distractors is changed. (Beginning with Book 9, 
order of distractors is held constant.) 

b. Sentences use words taughl* in previous readers. 




6. Tests of words in context, testing vowel s in color . 

a. Same as (5. a) above except: 

(1) Context is changed, but sentence patterns are the same. 

(2) Vowels are in color for all choices. 

b. Sentences use words taught in previous readers. 

Construction of Distractors 

1. Real words were used whenever they fit the criteria. 

2. Only the same element being tested is changed; other letters remain 
the same. 

3. All distractors used elements or letters that had appeared in the 
previous readers. 

4. All context items used sentences composed of words from previous 
readers . 

5. Consonant distractors. 

a. Similar vi sua My. 

b. Voiced alternatives used for voiceless stimuli and vice versa. 

c. Letters must have appeared in previous readers. 

d. Position of consonants within word was changed (e.g., ma£e, £ame). 

6. Consonant blend distractors. 

a. First letter changed (e.g., £lean — £lean). 

b. One letter deleted (e.g. , £lean — £ean — _[.ean). 

c. Replaced with another common blend. 

7. Vowel distractors. 

a. Replaced with another vowel (e.g., mai n — mean, loafs — \efs). 

b. Elements within word reversed (e.g., bi rd, bri d) . 

c. F i na I si lent £ deleted (e.g. , date — dat , I i f£~ I i f ) . 
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APPENDIX B 



Oral Sentences 

Sam likes the cake mother beaked. 

Sam and Nan slf at the table and eat it. 

Dad can fly the p^lane h^igh in the sky. 

Ted was i I I and h^ad to take a ^^i I I . 

Dad sai Is a boot. 

Sam c I i mbs a 1 ree. 

The meat is in the dish. 

Sa I I y I i kes do I Is. 

Dad reads a letter. 

Clean the di rt on the deck. 

At night it is dark. 

Ted climbs into the tree house. 

Nan hit the bal I . 

Nan opens the £ate. 

He sees me two days a week. 

Dad thinks dirty Tim needs a bath. 

Bess can ru_n fast. 

The mouse likes cheese. 

Dan reads a book to Sam. 

Mac eats his food. 

Mother's dress is not new. 

Tim si ngs a tune. 

The car lost a wheel . 

He makes too much noi se. 

We went on the train to visit Uncle Dan. 



New elements are designated by underlining. This underlining did not 
exist in the sentences presented to the students. 
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Mac shouts and ye I Is* 

Sally sang well without m£sic. 

Mac wins first pri£e. 

The hunters chdsed the red fox. 

At night it is quiet. 

Sam flies the j^et plane. 

Ed calls Helen on the telephone. 

A dime is ten £ents. 

The bird lived alone in a ca^e. 



62 



o 
o 

00 



a> 
o 

> 

o 

o 
o 



o 

< 
o 

CO 



> 
o 



> 

CO 







IT) 




CO 




in 




r- 


r- 


^' 


CO 


00 


CO 


eg 






CVJ 


CM 




r- 


eg 


r- 


CM 




in 


IT) 


IT) 


CM 


in 




CO 


(b 




d 


csi 


^' 




00 


00 


(0 


(0 






IT) 


(0 


(0 


IT) 





in 




CO 


CO 




in 


CO 




CO 


CO 




00 


r- 


o 


o 


IT) 




in 


d 




in 


(0 


If) 



o 

> 

c 



c 
c 

c 
o 
o 



O 

CO 



> 
o 



> 
CO 



S.D. 




CO 


0) 


0) 




1^ 


eg 




o> 


o> 

r- 


If) 
f— 


CO 


d 

CM 


d 


d 


CO 
CM 


IX 




O 


f~ 


q 


q 


q 


o 


q 


d 




f~ 

00 


If) 


d 
If) 




d 




S.D. 


q 


00 


CO 


0) 


CM 


CO 


CM 


q 


eg 


d 
eg 


If) 


d 

CM 


CM 


d 


d 

CO 


CO 


IX 


CO 








CO 


q 


o 




If) 


d 

(0 


d 


d 


CO 

If) 


(0 


d 
If) 


d 



a> 
o 

> 

a> 

o 



c 

c 
o 
o 



0) 

o 

> 



Z 
O 

o 



> 
o 

GC 



> 
00 



IX 



(D (0 



o 


q 






d 


d 


eg 


CO 


CM 


O) 


eg 


CO 


d 


CM 


d 









00 CO = 



3 



00 <o = ^ 



cn 



> 5 



E 

3 

E 



3 



o 



0) 

' E 

& S I. 

I ^ r 



q 


a> 


q 


d 


d 


CM 






f~ 






CM 


d 


d 


f~ 


CO 


CO 


CO 




OL 


CO 



E 

3 

E ° 



63 



o 
o 

CO 



O 

</5 



d 



in 



0> 



00 
0> 



00 



00 



> 

o 



C 

o 
o 



(X 



00 
00 



00 
O) 



00 
O) 



in 
d 
a> 



00 



o 

0> 



O 

00 



O 

CO 



0> 



CO 



in 



IT) 



in 



00 

in 



in 



CO 



> 

CO 



00 



M 
00 



in 

00 



00 



in 



O) 
O) 



00 



CO 



M 
CM 



q 

00 



00 



in 



O) 



CO 



in 



> 

o 
cc 



IX 



00* 



00 

in 
in 



CO 

in 



CN 
CO 



in 
in 



in 



d 



c 
o 
o 



0) in 



CD r- 



0) in 



z 
o 
o 



o 

CO 



CM 
CM 



o 



in 



in 



CN 



in 



O) 



O) 
M 



> 

CO 



IX 



00 



0) 
CO 



CD 



00 
CO 



in 



00 

in 



CO 



a> 
c 

c 

a 



0) 



'JE J2 



= 0) 
Q 0) 

> 1 



0) 00 — CN 

0) CO «^ 

I i 
I S 

Id 



"8 

E 



I 



E 

3 

ISO 



fie 

64 



O 
O 
00 



3 
o 
> 

o 

o 
o 

o 

z 

O 

< 

O 

00 



c 

CD 
C 

S! 

C 

o 
o 

"O 

c 



o 

> 



O 

< 
-J 

o 



> 
o 



q 



> 

o ■ 
t£ 



>. 



CN 
CN 



0) 
CN 
0) 



0) 
CN 



CO 

ai 

CO 



CO 



0) 
CN 

0) 
(O 



CO 



0> 



0) 



<£) 
00 



in 

r- 

CO 



00 



0) 

CO 

in 

CN 



CN 
1^ 



00 



in 
1^ 



p 
If) 

O) 



in 

CO 



in 
d 



1^ 

CN 

q 

in 
1^ 



CN 
CN 



in 

00 



S.D. 


o 

0) 


10.8 


10.7 


11.8 


CO 
00 


11.6 


'4.6 


13.9 


IX 


r- 


CO 




r- 


<£> 




CO 


in 


CN 


d 




00* 


CO 


CN 


CO 






0) 


00 


00 


00 


|v 00 




00 




CO 


00 


CN 


<£) 


<£) 


CO 


CO 


(0 


q 


r— 




0) 


<£) 


r- 


CO 


d 


d 


w 


CN 


CN 


r- 


r- 


CN 


r— 


CN 


CN 


IX 


79.6 


77.8 


83.3 


79.4 


74.4 


82.4 


74,2 


76.7 



o 

> 

"O 

0) 



o 

o 

•o 
c 



0) 

o 

> 



Z 
O 

o 



> 
o 



IX 



> 



IX 



CM 



0) 



0) in =5 



c: 
♦>» 
c 

}£ 
O 



o 



5 

- i 
I i ^ 



in 



E 

3 



CO 



o> 



in (O 



in 



r- LfJ 



0) > 

E o 



= ^ CO 

I i 

a 5J £ -o > 



65 C^r^ 

w' 



o 
o 

OQ 



a> 
o 

> 



o 
o 

o 



< 

-J 

o 



> 
(J 



> , 

CO 



d 


(0 


r- 


q 


q 




00 


q 


CD 


CO 


LO 

CO 


r* 
CN 


o> 


CO 


CN 

CO 


CO 
r* 


CO 


CO 


IX 


CN 


O 


o 


q 


q 


r" 


q 


o 


CN 
(O 


d 


u> 

CD 


LO 


d 


LO 


in 


d 

CD 


d 


CO 




q 


CO 




q 


O) 


q 


CO 


CN 


(b 

r- 


CN 


(d 

r- 


id 

r- 


CO 
CO 


^' 




IX 


66.7 


78.2 


56.0 


86.7 


76.7 


72.0 


72.5 


CO 
CO 

1^1 



Q. 

3 

O 
i. 

3 
CO 

■o 

- g 



(0 
Q. 



o 

X 

a 
z 

LU 
CL 
CL 
< 



C 

o 
a 

m 

a> 
QC 

o 
o 



CL 



c 
c 

c 
o 
o 

c 



o 

> 



O 

I- 
< 
-J 

O 



> 

o 

cc 



> 

CO 



0) 

o 

> 

o 

o 

c 



0) 

o 

> 

X 



o 

o 



> w 

o 

^ IX 



> 

CO 



IX 



d 






CO 


eg 


eg 






CN 


CO 








CN 
r* 


CO* 
CO 


r- 


CN* 


d 

CO 


IX 


q 


q 


q 


CN 


r- 


r- 




o 


d 

LO 


eg 

LO 


U) 


00* 


r- 


LO 
LO 


d 


CN 

to 


d 




eg 


CN 


q 




eg 


q 


r- 


(/) 


LO* 
r- 


CO* 
r- 


00* 


(O* 
r- 


CO* 


LO* 
r- 


CO 




IX 


q 


q 




q 


q 


q 


q 


q 


r- 


d 

LO 


r^' 


00* 
LO 




d 

LO 


eg* 

CD 


CN* 



0) 




q 


q 


r- 


o 


d 


LO* 


f^* 






d 


eg 


eg 


CN 






CO 




q 


U) 


q 


q 


(O 


d 




CO 


eg* 




00* 








LO 


CO 


CO 



0) 



Q> 

c 

a .2* 



CO 

CD (O _ 



q 




q 


d 


d 










q 




q 


eg* 


d 


d 


eg 


CO 


CN 


LO 


00 


CO 



5 

k 1 
l| 



E 
E 



o 



S E 

I? 
Id 



E 

0) > 

E 2 



ERIC 



66 



o 
o 

CQ 



o 

a 

JO 
3 
CO 



c 

s 

c 
o 

o 

z 
o 

< 
-J 

o 

c/) 



> 
o 



IX 



> 

CO 



IX 



(U 
CL 



o 

X 

o 
z 

LU 
CL 
CL 
< 



c 



0) 
I/I 

c 
o 

I/I 
0) 

o 
£ 

o 
o 

c 

0) 

u 

0) 
CL 



> 

o 
cc 



c 

(0 

c 

s 

c 
o 
O 

X 

ui 

Z 
O 

o 



>. 

CO 







OJ 


0) 


q 




OJ 


q 


d 




in 


d 


00* 


in* 


in 


OJ 










»~ 






»" 




CO 




»~ 


CO 


00 


CO 




(0 


O) 


0) 


00* 


CO 


O) 


O) 


in 


00 


00 


00 


00 


00 


00 


00 


00 





q 


OJ 


q 




in 


»— 


00 


CO 


»~ 


(0* 


«™ 




iri 






OJ 


»" 


OJ 




OJ 


in 


0) 




00 


q 


q 


OJ 


d 


CO 


in 


0) 


d 




d 


00 


00 


00 




00 


00 





S.D. 


27.2 


36.5 


32.5 


43.4 


31.1 


33.7 


55.6 


28.1 


IX 




OJ 


q 


CO 


CO 


OJ 


CO 


q 


d 


d 








f~ 


CO* 






CD 


in 


(O 


CO 


CO 


CO 


in 


CO 


z 


00 


00 


0) 


CO 


CO 




OJ 


CO 






CO 


f— 


q 


0) 


q 


q 


q 


d 


in 


o>* 


OJ 




d 


in* 


OJ* 


d 


CO 


OJ 


f" 


OJ 


OJ 




OJ 






IX 


61.4 


56.5 


58.9 


66.7 


48.8 


55.7 


72.6 


40.5 



in 



CO CO — 



o 



2 

Q o 

k i 

s- o 



E 

3 

E o 



li 
I? 
1^ 



CO CO 



E 

E o 




D 
Z 

LU 

a. 
a. 

< 



O 

a 

0) 



0) 



0) 



"O 

c 



c 

0) 

E 
> 

0) 

IE 
o 

< 



C 
C 

o 



o 
o 
CO 

c 

0) 



c 

0) 

E 

& (/) 

5 E 



> 



CO 



> — 



in 



c 

(0 



CO 







in 


CM 


(O 


o 






o> 


d 


OJ 


o 


00 


CM 


in 


CM 


in 


00 








CM 




IV 


in 


o 


IV 


CO 


^ 




CO 


(0 


d 


CM* 


CM* 


d 










T— 


r- 


r- 










00 


CO 


r- 


(O 


CM 


o 


o 






00 


CO 


IV 


00 


00 


o 


o 


IX 




IT) 


CO 


in 


CM 






in 






00* 


00* 


0) 


(0 










pg 


T— 


CM 




r- 


CM 


CM 


CM 




t" 






in 


(0 




CM 














(0 


o 


CO 


(O 


6 


0) 




CO 




in 


0) 


(O 


00 


CO 


(d 


d 


co' 


CM 


CO 


d 


d 


d 




t" 




















CO 




o 


o 




o 


IV 




(O 


CO 


in 


o 


o 




o 


(O 


IX 


(O 


00 


00 


CM 




rv 


in 


(O 




O) 


iO 


00* 


d 




IV 


d 


r * 










CM 






CM 





> 
a> 



(0 



> 

o - 



Q> CD 



c c 

(0 

o 

C/) U 

a> 
CC 



o 

S 



CO 



>, 

CO 



IX 





o 


CO 




in 


CM 


CO 


O 


in 


6 


00 


00 


o 


IV 


IV 


IV 


CO 


in 


CO 






CO 


^ 








IV 






00 


o 


0) 




CO 


o 


o 


IX 




00 


in 


CM 








00 






rv 




00 


in 


00 


o 


00 




CM 




CM 








CM* 




2 


0> 


rv 


CM 




rv 




in 


o 



CO 



(O 




0) 




CO 


CM 




CM 




. CO 


(O 


(O 


CM 




T— 


o 


o 




IV 


CO 




CM 


rv 


CO 


00 


(O 


<o 


rv 


CO 


in 













CO 00 =z 



3 

Q 
> 



O 



0> 

E 

t i 



IV O O = 



I ^ 



CM CO 



E 

3 

E 5 



IE 



E 

3 

E 



o 



ERIC 



69 



APPENDIX E 



Revised Tests 
TEST DIRECT IONS 

Words 

1. Find the box with the apple in it,'^ 
There are four words in the box. 

I shall read only one of the words in that box. 

You draw a line around the word I read. Ready? MAN 

Find the word MAN and draw a line around it. (Check to s'-.: 'f answers 
are correct; if not, repeat word. If still not correct , poin1 out 
correct answer for individual students, saying the word again.) 

2. Let's try another one. Find the box with the clock in it. I'm 
going to read one of those words and you draw a line around it. 
Ready? NEST . Draw a line around the word NEST . (Check and repeat 
procedure above. ) 

3. Now turn the page over. Find the flower at the top of the page. 
Look at the box with the flower in it. Put a line around the word 
AM. AM. 

(Repeat for clock: Ted 
tree: sad 
sa i I boat: mess 
key : den 
apple: dam 

Say each word twice and remind students to draw a line around the worn. 

4. (Procee-J 'or rest of test giving guidance for page turning and finding 
boxes . ) 



See test format on page 71. 
See test format on page 72. 
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Sentences 

Let's read the sentences at the top of the pa^;e. ":ied . Th,- 

there is a blank, isn't there?" One of the words undernearh the '.>erter 
c:;oes i n that b lank. 

Let's read the words below the sentence: ANT , SAT , THE , HEN. -^no c> 

The words goes in the sentence. Which one is it? Ned what? ve:>, 

the word is sat. Ned sat . Draw a line around the word sal^. Now let': 
read the next one. Who will read it? (Call on someone.) Yes, "Ted -^en^-.; 

the blank." Do this one by yourself. Put a line around the v;ord 

That belongs in the sentence. (Check.) Did you choose TENT ? Yes, Ted 
mends the tent. Now do the next sentence by yourself. Remember: Read 
the sentence aind the words below it. Draw a line around the word thc: + 
belongs in the sentence. 

Revised Test Format 
Book I 



Book 1 



SAMPLE 

dame 
man 
tang 
sent 




sent 
faste 
nest 
tent 




Name 



21 



Sentences begin in Book 2. See Samples A and B on page 74. 
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Revised Test Format 



Book I 



1. 



em 
earn 
aem 
*am 




4. 



me as 
*mess 
mass 
maes 




2. 



Ded 
Med 
*Ted 
Ned 




* den 
dem 
det 
des 




3. 



dad 
mad 
tad 
*sad 




mam 
sam 
♦darn 
tarn 
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Book 1 



Items Tested * 
Item Number 



Sample A 


dame 


man 


tang 


sent 


Sample B 


sent 


faste 


nest 


tent 


1 


em 


eam 


aem 


am 


2 


Ded 


Med 


Ted 


Ned 


3 


dad 


mad 


tad 


^ 


4 


meas 


mess 


mass 


maes 


5 


den 


dem 


det 


des 


6 


mam 


sam 


dam 


tam 


7 


sad 


mad 


dad 


nad 


8 


am 


as 


at 


ad 


Items in Color 
9** 


2 

fat 


1 

fat 






10 


2 

den 


1 

den 






Key to Grapheme / Phoneme Tested 








Item Number 


Grapheme/Phoneme 






1 


a (short a), or / dC/ 






2 


t (initial) / t / 








3 


s (initial) / s / 








4 


e (short e), or / e 


/ 






5 


n (final) / n / 








6 


d (initial) / d / 








7 


m (initial) / m / 








8 


t (final) / t / 








9 










10 


|/e/ 









*This table specifies items to be tested for each book, but actual test 
format wi II be simi lar to that found on pages 71 and 72. 

**Throughout Appendix E, certain letters or letter combinations appear with 
small superscripted numbers directly above them, e.g., fat or den. Each 
of these numbers corresponds to one of the colors used to color-code the 
various phoneme representations: I = red, 2 = light green, 3 = tan, 4 = 
purple, 5 = light blue, 6 = r^nk, 7 = orange, 8 = gray, 9 = dark green, 
10 = yellow, and II = chocol .te brown. In the tests administered to the 
children, these vowel graphemes are presented in actual color. 



Book 2 



Items Tested 

item Number 
Sample A 



dan 



tan 



man 



san 



Sample B 



sest 



test 



fest 



nest 



1 
2 
3 
4 
5 
6 
7 



sed 

Fannay 

dayd 

tatty 

saym 

Dadda 

me 



ted 
Fanna 
daed 
fatty 

sem 

Dadday 
mae 



fed 

Fannae 

ded 

satty 

seam 

Daddy 

ma 



ded 

Fanny 

deed 

matty 

saem 

Daddae 

maa 



Items in Color 
8 
9 



2 

ste^m 
1 

s^d 



3 

Steam 
2 

sgfid 



1 

Steam 

3 
seed 



Context 
Sample A 



Ned. 
ant 



sat 



the 



den 



Sample B 



Ted mends the . 
sand tan 



tent 



sat 



10 



Dad. 
nest 



the men. 

met ten 



net 



Key to Grapheme / Phoneme Tested 

Item Number Grapheme/Phoneme 

1 f/f / 

2 y (long e) / iy / 

3 ee / iy / 

4 f (Initial) /f/ 

5 ea /iy / 

6 y / iy / 

7 e / iy / 
3 

8 ea/ly/ 
3 

9 fifi /iy / 
10 context 




Book 3 



Items Tested 



Item Number 
Sample A 



dan 



tan 



man 



san 



Sample B 



sest 



test 



fest 



nest 



1 
2 
3 
4 
5 
6 

■7 
« 

8 
9 
10 
11 
12 



lid 

dete 

ste 

lack 

mace 

dea 

slet 

seen 

kind 

lame 

sa 

tend 



lied 
dat 
sty 
lat 

same 

de 

slait 

keen 

kend 

lefe 

say 

dend 



lad 

date 

stay 

lank 

tame 

day 

slight 

meen 

kand 

lif 

sy 

lend 



laid 

deet 

stea 

last 

came 

die 

sleet 

deen 

keend 

life 

sea 

fend 



Items in Color 
13 
14 
15 
16 



5 

lie 
2 

same 
1 

my 
4 

may 



4 

T 
same 

5 
my 
1 

may 



4 

4 

same 
my 

5 
may 



1'^ 

3 

same 

4 
my 

3 

may 



Context 

Sample A 
Sample B 



Ned. 
ant 



sat 



Ted mends the. 
sand tan 



the 



tent 



den 



sat 



17 



Nan 
feet 



fed 



.Taffy, 
mat 



ten 



18 



Taffy is . 



. the ants. 



tenting mending eating 



fatting 
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Book 3 (continued) 



Key to Grapheme / Phoneme Tested 



tern Number 


Grapheme/Phoneme 


1 


ai (long a) / ey / 




a • • e / ey / 


3 


y (long i) / ay / 


4 


ck (final) / k / 


5 


c (initial) / k / 


6 


ie / ay / 


7 


igh / ay / 


8 


k (initial) / k / 


9 


i (ind) / ay / 


10 


i • • e / ay / 


11 


ay / ey / 


12 


1/1/ 


13 


4 

ie / ay / 


14 


5 

a/ey / 


15 


4 

y / ay / 


16 


5 

ay /ey / 


17 


context 


18 


context 
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Book 4 



Items Tested 
Item Number 

1 keck 

2 lamb 

3 mess 

4 lase 

5 dank 

6 bame 

Items in Colo r ^ 

7 lid 

2 

8 kiss 



kaik kack kick 

lanb lab land 

miss mass maiss 

base mase dase 

lank bank tank 

lame blame flame 

5 6 2 

lid lid l[d 

6 ^4 

k\$s kiss kiss 



ERIC 



Context 

9 Nan needs a. 



came my dim dime 

10 Dad a mess. 

mall mile made mad 

1 1 Mac and Ed fly the . 



plan clean plane plant 



Key to Grapheme / Phoneme Tested 

Item Number Grapheme/Phoneme 

1 i (short i)/i/ 

2 b (silentb)/0 / 

3 i/i/ 

4 b/b/ 

5 b/b/ 

6 bl / bl / 

f/i/ 

8 i/i/ 

9 context 

10 context 

11 context 



O 11 



Book 5 



Items Tested 

item Number 
1 
2 
3 
4 
5 
6 



bem 

may 

slain 

cain 

late 

lass 



lem 
mad 
lain 
pain 
date 



stem 

map 

plain 

fain 

hate 

mass 



hem 

mat 

pain 

main 

fate 

pass 



Context 



Ted and Sam the can. 

mike ten meal kick 

Nan can feed the . 



take lamb sky met 



Ned steals a_ 



make sick bike den 



Key to Grapheme / Phoneme Tested 

Item Number Grapheme/Phoneme 

1 h/h/ 

2 p (final) /p/ 

3 pi / pi / 

4 p/p/ 

5 h/h/ 

6 p/p/ 

7 context 

8 context 

9 context 
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Book 6 



Items Tested 

Item Number 
1 
2 
3 
4 
5 
6 
7 
8 
9 



drab 

leafs 

med 

past 

cade 

slame 

bright 

fellay 

shame 



cab 

loafs 

fed 

post 

cede 

same 

right 

fellea 

slame 



brab 

laifs 

ned 

pest 

cide 

shame 

bight 

fellie 

same 



crab 

lefs 

red 

pist 

code 

chame 

spight 

fellow 

chame 



Items in Color 
10 

11 

12 

13 



5 

faid 
1 

slow 
4 

coat 
1 

hole 



fold 

4 

slow 
5 

coat 

7 
hole 



Context 

14 Ted climbed the. 



bill fill hii! pill 

15 Tim can in the tent. 

line main sleep sleek 

16 Dad can fly at night. 

hate sight map high 



Kev to Grapheme / Phoneme Tested 


Item Number 


Grapheme/Phoneme 


1 


cr / kr / 


2 


oa (long o) / ow / 


3 


xlxl 


4 


0 / ow / 


5 


0-e / ow / 


6 


sh/s^/ 


7 


br / br / 


8 


ow / ow / 


9 


sh/sl 


10 


0 / ow / 


11 


ow/ ow / 


12 


oa / ow / 


13 


g-e / ow / 


14 


context 


15 


context 


16 


context 
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Book 7 



Items Tested 
Item Number 

1 spit 

2 dinnen 

3 stin 

4 fin 

5 cert 

6 shrin 

7 tun key 

Items in Color 

Z 5 

8 shirt 

9 dirt 

4 

1 0 crop 

"4 

1 1 letter 

4 

12 purse 



spurt spot spet 

dinnar dinner dinney 

stig stink sting 

fir fri far 

cant crat cart 

shring shrink shriek 

turkey trakey tarkey 



^8 9 4 

shirt shirt shirt 

,9 4" 

d^rt dgrt dgrt 

9 5 ' g 

crop crop crgp 

9 8 § 

letter letter letter 

5 8 9 

purse pyrse pvirse 



ERIC 



Context 

13 Ar.d\ eats the. 



den pane bone bed 



14 Dan slides fast in the , 



smell snow fEow show 



15 Ned sails in the 



beat mend bed boat 



Key to Grapheme / Phoneme Tested 

item Number Grapheme/Phoneme 

1 0 (short 0) / a / 

2 er/ar/ 

3 ng (final) / ng / 

4 ir/ar/ 

5 ar / a / 



nk (final) / r)k / 



6 

7 ur/ar/ 

8 ?r/ar/ 

9 a/a/ 

10 o/a/ 

11 ^/ar/ 

12 i?r/ar/ 

13 context 

14 context 

15 context 
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Book 8 



Items Tested 
Item Number 

1 

2 

3 

4 

5 



crowss 

scale 

ram 

smile 

clurds 



crass 

scorl 

ray 

smill 

clouds 



cross 

scoal 

raw 

smell 

clodes 



cress 

scowl 

row 

small 

clawds 



Items in Color 
6 
7 
8 
9 
10 



.5 
bflss 

claw 
11 
loyd 
9 

Qvyl 
5 

call 



DQSS 
11 

claw 

loud 
11 

call 



11 

bQSS 
10 

claw 

7 

loud 



7 

bgss 
7 

claw 

10 
iQMd 
11 

owl 
call 



Context 
11 



Mother makes a 

shaping shopping 



list. 



shurping shipping 



12 



Betty mends 

hen had 



dress, 
her 



next 



13 



Ned sees a 

car ship 



.in the tree, 
barn 



bird 



Key to Grapheme / Phoneme Tested 
Item Number Grapheme/Phoneme 



1 
2 
3 
4 
5 

6 

7 

8 

10 
11 
12 
13 



o <open) / 0 / 

ow (as in cow) / aw / 

aw / 0 / 

a/ 0/ 

ou'/aw/ 

aw/ 0/ 
qu / aw / 
ow / aw / 

Vi.i 

context 
context 
context 
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Book 9 



Items Tested 



Item Number 
1 
2 
3 
4 
5 
6 
7 



lift 

grad 

sell 

brod 

prade 

dumb 

wipes 



kift 

drad 

snell 

broth 

glade 

thumb 

mipes 



gift 

dray 

sweli 

brock 

crade 

tumb 

ripes 



pift 

drag 

smell 

brot 

grade 

shumb 

tipes 



Context 
8 



Dan sees the red . 
dime hope 



house 



snow 



10 



Mother smells the_ 
scowl flowers 

Nan sees Ed 

bill row 



floaters 

. the street, 
lawn 



plays 



cross 



Key to Grapheme / Phoneme Tested 



Item Number 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 



Grapheme/Phoneme 

g/g/ 

w / w / 

sw / sw / 

th (final) 1^1 

gr / gr / 

th 1^1 

g (final) / g / 

context 

context 

context 



Book 10 



Items Tested 
Item Number 

1 coal cul cool cole 

2 hilt hith hish hitch 

3 suffer saffer soffer siffer 

4 croak crook croke crik 

5 hapel thapel shapel chapel 

6 mice micy mica mico 

7 melean melon melain meloon 

Context 

8 Sally is not a bad . 

grow girl clock meal 

9 Dad drinks the . 

wall meat mother water 

10 His tie is . 

green thumb girl grass 

Key to Grapheme / Phoneme Tested 

Item Number Grapheme/Phoneme 

1 00 (as in moon) / uw / 

2 tch (final) / c/ 

3 u (short u) / d / 

4 00 (as in look) / u / 

5 ch / c*/ 

6 a/ 9/ 

7 o/d/ 

8 context 

9 context 
10 context 
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Book 11 



items Tested 
Item Number 

1 

2 

3 

4 

5 

6 

7 

8 



moast 

jerel 

note 

veast 

annay 

clur 

whine 

mile 



moust 

jawel 

vote 

teast 

annoy 

clow 

chine 

mull 



moist 

jewel 

fote 

gcast 

anney 

claw 

thine 

mule 



morst 

jowel 

wote 

yeast 

annow 

clue 

shine 

mole 



Context 



Tim eats the . 

fan food soon tool 



10 Mac will to catch the ball. 

boat smell tan run 

11 At the beach, the water is . 



sand cool sipped coal 



Key to Grapheme / Phoneme Tested 

Item Number Grapheme/Phoneme 

1 oi / :>y/ 

2 ew/uw/ 

3 V (initial) / v / 

4 y (initial) / y / 
• 5 oy / jy / 

6 ue/uw/ 

7 wh / hw / 

8 u-e / yuw / 

9 context 

1 0 context 

1 1 context 
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Book 12 



Items Tested 
Item Number 



1 


pow 


paw 


pew 


pey 


2 


taki 


tasi 


togi 


taxi 


3 


koin 


doin 


join 


loin 


4 


wine 


mine 


sine 


zinc 


5 


question 


pestion 


crestion 


kestion 


6 


paupils 


pupils 


poupils 


popils 


7 


keneral 


peneral 


sheneral 


general 


8 


kedar 


nedar 


cedar 


zedar 


9 


thysical 


physical 


pysical 


vysical 



Context 

10 The baby plays with the_ 



ten toy tea fast 



1 1 The plane makes a lot of , 



mou se nose noise not 



12 The sky is. 



cow blue blow blur 



Key to Grapheme / Phoneme Tested 

Item Number Grapheme/Phoneme 

1 ew (long u) / yuw/ 

2 X (final) /ks/ 

3 i/i/ 

4 z/z/-^ 

5 qu/kuA' 

6 u / yuw/ 

7 g/j/ 

8 c/s/ 

9 ph/f/ 

10 context 

11 context 

12 context 
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